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NETWORK INFERENCE METHODS 

JeffFox 
Colin Hill 
Vipul Periwal 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims priority to U.S. Provisional Patent Application 
Serial No. 60/344,527, filed on November 1, 2001, and U.S. Provisional Patent Application 
Serial No. 60/406,764, filed on August 29, 2002, both hereby incorporated herein by 
reference in their entireties. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The disclosed invention relates to bioinformatic methods and systems, 
specifically to network modeling and simulation of cellular functions. 

Description of the Related Art 

[0003] The space of possible biological system networks for n species of, 
interacting molecules increases factorially in the number of species. As such, there is no 
known, rational, probabilistic search strategy that can adequately sample the space of 
networks to infer the correct architecture of a dynamical system that can simulate the time, 
course, and other forms (possibly including qualitative forms) of experimental biological 
data. There is, in addition, the serious problem of an inadequate amount of data given the 
vast number of possible network architectures and the corresponding high-dimensional 
space of possible kinetic coefficients and initial conditions. 

[0004] Accordingly, what is needed is a search strategy that reduces the network 
search space down to a smaller space that can then be sampled probabilistically to identify 
candidate architectures for computer simulation of the biological system. 
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SUMMARY 

[0005] Presently disclosed are methods for inferring a network model of the 
interactions of biological molecules that are involved in the functioning of life forms and 
systems for practicing such methods. The network to be inferred involves the interactions of 
proteins with other proteins, the interactions of proteins with nuclear DNA, the expression 
and translation into proteins of mRNA, the actions of enzymes, and the combinatoric control 
of gene expression. The systems and methods described herein provide a systematic and 
computationally feasible solution to the problem of rational inference of the architecture of 
biological networks. These methods are based on a combination of rational and statistical 
evaluations of quantitative and qualitative data, together and separately. These methods 
constrain the search space of possible biological interaction networks and, in some 
embodiments, allow the online addition of new data into an existing model without any 
interruption in analysis. Additionally, these methods and systems can automatically provide 
a concrete, quantitative evaluation of the confidence levels associated with the putative 
network architectures discovered thereby. The methods presently disclosed naturally 
incorporate latent nodes in the search space of possible architectures; hence, the system is 
also capable of predicting new interactions and/or substrates for the biological system or 
systems being studied. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0006] The present disclosure may be better understood and its numerous features 
and advantages made apparent to those skilled in the art by referencing the accompanying 
drawings. 

Figure 1 A is a histogram of the mammalian cell cycle derived from the 
Kohn Map. 

Figure IB is the data of Fig. la plotted in log-log format. 

Figure 2 shows the theoretically obtained critical value of bias p as a 
function of the mean number of inputs K mea n. 

Figures 3 A and 3B show the fraction of disordered (period >1500) 
networks as a function of p for K=4 and 6 and N=100. 
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Figures 4A, 4B, and 4C show the fraction of active, or unfrozen, 
elements in a network as a function of bias p for K=2, 4, and 6 and 
N=100 

Figure 5 shows the lower bound of the fraction of frozen elements in 
power law networks as a function of the exponent beta in the power 
law with a bias p=0.5. 

Figure 6 is schematic of four types of node classifications, according to 
one embodiment of the present invention. 

Figure 7 is flowchart of a network inference process, according to one 
embodiment of the present invention. 

Figure 8 depicts schematically one process for inferring a biological 
network, according to one embodiment of the present invention. 

[0007] The vise of the same reference symbols in different drawings indicates 
similar or identical items. 

BEST MODE FOR CARRYING OUT THE INVENTION 

DETAILED DESCRIPTION 
Introduction 

[0008] Presently disclosed is a search method that reduces a network search space 
down to a smaller space that can then be sampled probabilistically with the aim of finding 
the right network architecture for a computer simulation of a biological system. It allows the 
inference of latent nodes and interactions, thereby predicting the existence of certain 
interactions that may then be experimentally confirmed. 

[0009] This network inference technique, in its general form, is used to fill in the 
unknowns of a network model of a biological system based on various observed or real 
world data. This observed data includes experimental data, observations in vivo, 
observations based on desired network robustness or bioinformatic predictions, etc. In fact, 
the data that is used to fill in the unknowns is actually "all that is known" about the biologic 
system, including all that is known with some non-unity confidence interval, i.e., 
observations that are only true with a certain probability. The resulting ensemble of 
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candidates, which is also referred to as a Bayesian ensemble, is then used as a whole to make 
predictions of biological system performance. 

[0010] The ensemble tests hypotheses of biologic activity but in a computationally 
realistic manner. This is necessary because, in reality, there are thousands of possible 
interactions, inputs, and outputs to the biological system. The potential for thousands of 
inputs and outputs can result in 2 1000+ combinatoric hypothetical^ Checking that many 
hypothetical models in an exhaustive sense is computationally impossible. 

[0011] The foundation of the present method is the discovery that the topology of a 
biochemical network profoundly influences the behavior of that network. In particular, the 
relationship between network topology and behavior can be discerned at least in part by the 
degree of order actually present in the network. Recent analysis (described below) has 
shown that for a large class of networks that have been used over the past three decades to 
study the regulation of gene networks (a term construed here to include the interactions of 
the genes, the proteins they are translated into, the post-translational modifications of the 
proteins, and other molecules of biological relevance), finite scale-free networks are more 
ordered than other types of networks such as delta function networks and Poisson networks. 
Thus, the topology of scale-free networks, characterized by a wide distribution in the 
number of inputs per element, can actually provide a source of ordered dynamics in 
biological systems. At the same time, it is also well-known to those skilled in the art that the 
generic dynamical system is chaotic in its behavior. The search strategy for the inference of 
possible architectures for biological systems is thus biased by an a priori distribution, such 
as a Bayesian prior, on the space of models that favbrs models with scale-free architectures. 
The resulting bias-reduced search space and the scale-free network optimization may then be 
implemented with a practical search algorithm in order to realize the desired reduced-space 
search. Some possible embodiments of such a search algorithm are further described below. 

[0012] An important factor in scale-free prior design is the fact that the power of 
the power law which governs the network architecture is initially unknown: any search 
strategy used must find a cost function that does not require a priori knowledge of the power 
of the power law distribution governing the network. Two examples of such a cost function, 
which can be readily generalized by one of ordinary skill in the art without undue 
experimentation while preserving the essential property mentioned above, may be described 
as follows: 
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[0013] Let N(k) be the number of species of molecules that have k connections to 
other species of molecules in the biochemical network, A is a positive real number (the 



power in the power law distribution), and C is a positive real constant Observe that if one 
defines a quantity: 



N(p)N(q) 
N(pq) 



where p and q are positive integers, then the function S defined by: 




(where Q = Average value of {x p>q } and are positive real constants) is positive semi- 
definite and only vanishes when N k = Ck" A , where A is the power of the power law 
distribution and C is a positive real number. If any of N(p), N(q) or N(pq) vanishes for some 
value of p or q, the corresponding tenn(s) in S is(are) be replaced by a positive number (e.g., 
1), or the value of Rp, q is set to vanish for these terms. 

[0014] Notice that the function S does not assume the value of A. The 
minimization of S in the search over network topologies will lead exactly to networks with 
scale-free distributions of links between elements. Observe also that the positive real 
constants Rp fl can be taken to be an arbitrary function of p and q, including the simplest 
form R p ,q = 1 . Any arbitrary monotonic positive semi-definite function of 



can also be used in this definition, including different functions for different values of p and 
q. An alternative cost function S can also be given: 



s=lB P S(y Pira +—- 



2) 



where the inner sum is over integers m that divide p, and 



N(p/m)N(pm) 
N(p) 2 
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If any of N(p), N(m) or N(p/m) vanishes for some value of p or m, the corresponding term(s) 
in S is(are) be replaced by a positive number, or the value of B p is set to vanish for these 
terms. 

[0015] With such functions S in hand, the steps required to perform the network 
inference are as follows, described with reference to Figure 7: 

1. Construct a random network of links, 710, consistent with known concrete biological 
data. 

2. Propose a new a link to the network (step 720), accepting the new link if it lowers 
the value of S (test 730). Alternately (step 740), accept the link with probability exp 
(-AS) if S increases, where AS (deltaS) is the change in S upon adding the link to the 
network. 

3. Simulate the behavior of the network 750 to find optimal values of network 
parameters such that the network reproduces qualitatively or quantitatively known 
quantitative or qualitative biological experimental information, using a simulation 
platform such as the E-Cell, A-Cell, or M-Cell cell biology simulations, which are 
well-known research tools currently in use today. Alternatively, publicly available 
software packages that simulate systems of differential equations (as in the field of 
non-linear dynamics) maybe used, since the underlying equations describing such 
networks are in fact differential equations. Examples of suitable differential 
equation system simulations are Content (by Dynamical System Software) and 
DsTool, the Dynamical Systems Toolkit, available from the Center for Applied 
Mathematics at Cornell University, http://www.cam.cornell.edu. 

4. Go back to step 720 until either: 

a) the decrease in S is below a certain threshold set by (for example) a small 
percentage of the magnitude of S (test 760); or 

b) the decrease in the simulation cost function as implemented in a simulation 
platform is below a certain threshold (test 770) determined by (for example) the 
uncertainty in the experimental cell information available. (In other words, if 
either of tests 760 or 770 are true, end at step 799.) 



[0016] The output of this algorithm is a set of scale-free networks which 
reproduces the experimental data. New nodes in these inferred networks can then be tested 
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in independent biological experiments, either on a network-by-network basis or on all the 
networks in the set, which may be further refined by other analysis. 

Modeling 

[0017] The present invention is a method of constraining the number of 
hypothetical networks that represent a biological system with a certain confidence. This 
constrained set, the Bayesian ensemble (taken as a whole), is by definition a robust predictor 
of the biologic behavior. 

[0018] Abstract formulations of the regulation of gene expression as random 
Boolean switching networks have been studied extensively over the past three decades. 
These models have been developed to make statistical predictions of the types of dynamics 
observed in biological networks based on network topology and interaction bias, p. For 
values of mean connectivity chosen to correspond to real biological networks, these models 
predict disordered dynamics. However, chaotic dynamics seems to be absent from the 
functioning of a normal cell. While these models use a fixed number of inputs for each 
element in the network, recent experimental evidence suggests that several biological 
networks have distributions in connectivity. We therefore study randomly constructed 
Boolean networks with distributions in the number of inputs, K, to each element We study 
three distributions: delta function, Poisson, and power law (scale-free). We analytically 
show that the critical value of the interaction bias parameter, p, above which steady state 
behavior is observed, is independent of the distribution in the limit of the number of 
elements N -> a>. We also study these networks numerically. Using three different 
measures, (types of attractors, fraction of elements that are active, and length of period), we 
show that finite, scale-free networks are more ordered than either the Poisson or delta 
function networks below the critical point. Thus the topology of scale-free biochemical 
networks, characterized by a wide distribution in the number of inputs per element, may 
provide a source of order in living cells. 

[0019] Abstract models of gene regulation networks suggest that real cells should 
display chaotic dynamics. Experimental evidence suggests otherwise. We propose that a 
distributed connectivity, shown to have profound effects in other complex networks, may be 
the source of order in the biochemical circuits that control cellular behavior. 
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• Introduction 

[0020] The human genome has now been sequenced and many other genome 
sequencing projects are nearing completion. Concurrently, methods to identify protein- 
protein interactions, 1 as well as trans-acting regulatory proteins and cis-acting regulatory 
binding sites on a genome-wide scale are being developed. 23 [Note that the superscripted 
numerals refer to reference material listed at the end of this section.] Thus, the complete 
topology of gene expression networks and signal transduction pathways that control cellular 
behavior is beginning to materialize. What is the significance of this topology to the 
functioning of a cell? Cellular function depends on the dynamics of the mKNA and protein 
concentrations that comprise the biochemical networks that make up a cell. Thus, 
understanding the relationship between the topology of these biochemical networks and their 
dynamics may provide some insight into the regulatory organization found in biochemical 
networks. 

[0021] The relationship between topology and the dynamical states of large 
biological networks has been studied using abstract randomly constructed Boolean 
networks. 4 These networks are characterized by a fixed number of inputs, K, per element 
and an interaction bias p. 4 While this formulation has obvious limitations compared to 
models with more realistic representations of the chemical kinetics, a number of results have 
been shown to be robust in the transition to the more realistic piecewise linear and nonlinear 
equation formulation. 5 " 7 While Bagley and Glass showed that some attractors in the 
Boolean switching network models are artifacts of the synchronous updating and 
discretization of state space and time, the classification of the dynamical attractors of 
particular networks were shown to remain invariant in the piecewise linear and nonlinear 
equations. 6 Also, it is the only framework in which large-scale statistical properties can be 
studied readily. It was shown by Kauffinan 4 that increasing the number of inputs per 
element pushed the system through a transition from steady state dynamics to periodic and 
finally to "disordered" dynamics in which the length of the cycle grows exponentially with 
the number of elements in the system. For an equal distribution of "on" and "off* states for 
the activity of an element (p=0.5), the transition is predicted to occur at two inputs per 
element. 

[0022] Recent experimental work suggests that the number of inputs per element 
in real biochemical networks is greater than two, leading to a prediction of "disorder" or 
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chaotic dynamics in cells. However, this prediction does not agree with experimental 
observations. The biological processes studied thus far can be classified into the following 
dynamical states: those displaying fixed point behavior such as the lac Operon in E. coli? 
and those with periodic dynamics such as the mammalian cell cycle, circadian rhythms in 
Drosophila, the Glycolysis pathway, and Ca2+ signaling. 9 Chaotic dynamics seems to be 
absent from the fundamental dynamical states of a normal cell. 

[0023] The dynamics of cellular systems may depend on the connectivity of the 
underlying biochemical circuits. Recent research has begun to elucidate the topology of real 
cellular networks. This effort has lead to the discovery of several examples of cellular 
networks that have a mean number of inputs larger than the critical value of two and that are 
characterized by wide distributions in connectivity. As evidence of distributed connectivity 
in real biochemical circuits, we cite three examples: metabolic networks, 10 yeast protein- 
protein interaction networks, 1 and mammalian cell cycle networks. 11 

[0024] Jeong, et al., 10 did an extensive study of metabolic networks in 43 different 
organisms. They found that all of these networks had power law distributions, with an 
average exponent of 2. 2 A specific example is the S. cerevisiae metabolic network. This 
network has 561 elements, with a power law exponent of 2.0, corresponding to a mean of 
4.20 inputs per element. 

[0025] Using yeast 2-hybrid methods on a genome wide scale, researchers at 
Curagen and Washington University have examined protein-protein interactions in yeast. 1 
Using yeast 2-hybrid technology to detect in vivo protein-protein interactions, they estimated 
the mean connectivity for yeast to be between 1.8 and 3.3. Also, they found many examples 
of proteins that have far more interactions than the mean. Their data suggest that the yeast 
protein-protein network likely has a broad distribution of connectivity. 

[0026] Finally, Kohn 1 1 has compiled a comprehensive map of known interactions 
in the mammalian cell cycle. Although the network and its topology are not completely 
known, the Kohn Map can provide a useful estimate of the distribution of connectivity in the 
mammalian cell cycle, which is known to have kicked-periodic dynamics under normal 
conditions of growth factor and hormone controlled cell division. To establish the 
connectivity of this network, we counted the number of inputs and outputs per protein and 
gene. Figure 1 A shows the histogram acquired from the Kohn Map. The total number of 
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elements is 1 00, with a mean connectivity of 3.65. Figure IB illustrates the fitted power law 
of the distribution. The exponent is 1.12. 

[0027] In the framework of Kaufiman networks, the mean connectivities of these 
examples suggest that real biological networks should display "disordered" dynamics. The 
fact that biological networks display ordered dynamics forces the question of the origin of 
this order. Some have approached this question from the point of view of biases in 
interactions such as canalizing functions, 12 and internal homogeneity. 12 While this may 
account for the order of these systems, topology may also play a role. In particular, the 
assumption that biochemical networks have a fixed number of inputs has no biophysical 
basis and appears to be in contradiction to emerging experimental evidence. 1,10,11 We expect 
that a distribution in the number of inputs K may affect the dynamics of biochemical 
networks and may be a source of the order observed in real cells. 

[0028] Recently, the effects of topology on properties of very large networks have 
been studied in the context of complex systems. Watts and Strogatz 13 investigated "small 
world" networks, showing that seemingly small changes in topology in locally connected 
networks can greatly affect global properties such as average distance between nodes in a 
network and the rate of information propagation. Scale-free networks, characterized by 
power law distribution in connectivity, have also been studied. Several examples of large 
networks that show scale-free organization have been found: the World Wide Web, social 
networks, and power grid nets, 14 as well as the previously mentioned metabolic networks. 
Such networks are robust and error tolerant. 15 Also, a mechanism has been suggested 
whereby such organization could naturally arise in a growing network. 14 However, the 
effect that network topology may have on dynamics has not been addressed. 

[0029] Motivated by experimental evidence just highlighted, we investigate how a 
distribution of the number of inputs per element affects the dynamics of biochemical 
networks. We investigate delta function, Poisson, and power law distributions in the 
framework of Boolean networks. We analytically show that the critical value of the 
interaction bias parameter, p, is independent of the distribution in the limit of the number of 
elements N -> oo. We also study these networks numerically using three different measures: 
types of attractors observed, fraction of active elements, and length of periodic orbits. We 
show that for finite networks below the critical point, a power law distribution produces 
networks that are more ordered than either the Poisson or delta function distributions. These 
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results suggest that the recently characterized broad distribution in the number of inputs per 
element may provide a source of order in biochemical networks. 

• Definition of Model 

[0030] The model that we study is a modification of the extensively studied 
Kauffinan network. 4,16 * 22 In this model, we allow each element of the network a { to take on 
the values of 0 or 1. The i to element receives input from K, other elements in the network. 
These K, inputs are chosen at random from the N elements. Self-inputs are allowed, but 
multiple inputs from the same element are not allowed. In our study, we choose Ki from a 
distribution P(K), as opposed to the fixed K (delta function distribution) used in the original 
Kauffinan model. P(K) is nonzero only for values of K between 1 and some cutoff Kmax that 
should be equal to N, the number of elements in the network. However, due to restrictions 
on computer memory and time, we use Kw^O if N is larger than 30. 

[0031] To compute the time evolution of the system, the i* element has an 
associated Boolean function, or rule table, Bi, which maps the state of all K, input elements 
to an output state of either 0 or 1. The fraction of "1" output states is designated as the 
biasing parameter p. Because of the symmetry of p around .5, we can choose .5 £ p <> 1.0 . 
The evolution of the system takes place in discrete time steps. At each step, all N elements 
in the network are updated synchronously. Once the rule table and all the connectivities 
have been defined, we initialize each element in the network randomly, and then update the 
network synchronously for 500 time steps to allow transients to die off. We continue 
updating until we either hit an arbitrarily chosen cutoff or find a fixed or periodic state. 

[0032] In general, Boolean networks will move into one of three different types of 
attractors. 4 The system can fall into a fixed state, a periodic state, or a "disordered" state. A 
disordered state is characterized by periods that grow exponentially with N, the number of 
elements in the network. Thus for large N, these states appear to be non-repeating or 
aperiodic. Deciding how long a period must be to be termed disordered is arbitrary: there is 
no clear boundary between the periodic and disordered states. We choose a cutoff of 1500. 

[0033] We characterize the dynamics of networks having three types of 
distribution functions P(K). In particular, we look at the following distributions: 

1 . The delta function distribution, where P(K) is nonzero only for 

K~Kmcan- 
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2. The Poisson distribution, given by P(K) = — ^j— , with x=K mcan . If 

the random value for Kj chosen from this distribution is zero we 
assign Ki =1, and if the value lies above Kmax we set Ki =Kmax. 

3. A power law distribution given by P(K)=A *K fi , for 1 £ K < . 
Here we chose the exponent p by picking the mean of the distribution 
to be equal to Kmean. The coefficient A is determined by requiring 
P(K) to be normalized. 

• Results 

[0034] First, we analytically study an order parameter of these networks: the 
fraction of elements in a network that remains active after an initial transient. Studying this 
order parameter allows us to make predictions about the location of the critical point. At 
this point the network goes from a frozen state to one with a finite fraction of active 
elements. We also study the system numerically using three different measures. We first 
classify the types of attractors as a function of bias p and mean connectivity Kmean. Next we 
characterize the networks in terms of the order parameter. Finally, we measure the lengths 
of periodic orbits. In all three measures, the power law networks show more order. 

• A. Analytical results 

[0035] First we look at the fraction u of the network that remains active after an 
initial transient. Previously, this quantity u^ufoKmean) was studied in the original Kauffinan 
network as a function of the bias p and the mean connectivity K^can. This quantity was first 
studied using an annealed approximation. 17,18 Later, Flyvbjerg 19 found an analytical 
expression for the critical value of p at which a network with a fixed connectivity for each 
element would undergo a phase transition from a totally frozen state to one where a finite 
fraction of the elements are active. This analysis was done in the limit as N -> oo (the 

1 | 2 

thermodynamic limit). This critical point is given byp crit = - (1 +^1 ) 

[0036] We extend Flyvbjerg's analysis to the case where the connectivity of each 
element Ki is chosen from a distribution P(K). We find a map that expresses how the 
"frozen component" grows during a time step as a function of its size at the previous time 
step. The frozen component at time t is defined as the fraction s(t) of elements in the 
network that do not change after time t. Thus we are looking for a map F(s) such that 
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s(t + 1) = F(s(t)) . We look at a specific element with K inputs. There are in general K+l 
ways for this element to be engulfed by the frozen component. We write down these 
probabilities and then sum all K+ 1 terms to find the total probability that an element will 
become frozen. For example, the "zeroth" way for this to occur is if all K inputs to the 

00 

element are frozen. The probability of this occurring is given by £ s K P(K) , where P(K) is 
again the distribution of inputs. The appendix shows the complete calculation. 



[0037] The final result is given by p crit = - (1 + Jl - - — ) where K mean is the 

2 V J\jiwan 

mean value of K. In the thermodynamic limit, the only quantity the critical point depends on 
is the average value of KL Figure 2 shows a plot of the critical point as a function of the 

• B. Numerical results 

[0038] We ran simulations of networks with N=100 using three different 
distributions P(K): a delta function, a Poisson distribution, and a power law, as discussed 
previously. All data were averaged over 500 trials, each with a different network realization 
and one initial condition per network. These simulations were written in C23 and run on 
Sun workstations and Apple Macintosh G3 processors. We calculated several quantities 
(after an initial transient of 500 time steps) as a function of the bias p for Kmean^, 4, 6. 

[0039] Attractor classification : We first studied the types of attractors that exist 
for these networks as a function of p and Kmcan- We measured the fraction of networks that 
become fixed, periodic, and disordered, for all three distributions. Figures 3A and 3B shows 
the fraction of disordered networks as a function of p for K^an^ and Kmean=6, respectively. 
Comparing Figures 3 A and 3B to Figure 2 we see that the transition between a zero and 
nonzero fraction of disordered networks is in good agreement with the theoretically obtained 
critical point. We also note that in the regime where a significant fraction of networks are 
disordered, the power law networks show considerably more order. This is particularly 
apparent for the K me an=4 graph, in which the power law nets clearly have a larger fraction of 
periodic solutions. 

[0040] Fraction of active elements : Figures 4A through 4C show the fraction of 
active elements as a function of p for three values of K^an. We mention that if fixed and 
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periodic behavior can occur for the same value of p and Kmean, we see large error bars 
(which we leave off in the interest of clarity) on the fraction of active elements in a network. 
For example, at KmnrG and p=.5, where both fixed and periodic solutions can occur, the 
error bars extend from 0.0 to roughly .4. The fact that these attractors tend to coexist near 
the critical point makes it difficult to find the critical point numerically using this order 
parameter for finite values of N. However, the rough position seems to be in good 
agreement with the theory. We note that the power law distributions produce a large 
fraction of frozen elements even for large K^ean and a bias of .5 . In contrast, the delta 
function networks have a steep increase in active elements below the critical point. 

[0041] We can understand the large frozen component in the power law networks 
in the so called disordered regime by noting that even if Kmcan is large, a significant fraction 
of the elements in the network will have a value of K=l or K=2. We can write an 
expression for the lower bound on the size of the frozen component by asking what fraction 
of the network will be frozen due to elements whose states are independent of their rule 

CO 

tables. This lower bound is given by = P( K) * p K , where P(K) is the distribution of 

inputs K, and pk is the probability of an element being independent of all K of its inputs. 
We can analytically compute this lower bound for the power law distribution as a function 
of the exponent p. As K^an becomes large, we expect the actual steady state fraction of 
frozen elements to approach this lower bound. Figure 5 illustrates this point 

[0042] Length of period : Finally, we measured the average period length of 
periodic networks as a function of the bias p for those values of p and K mea n that produce 
periodic dynamics. We again observe that the networks with power law distributions appear 
more ordered than the Poisson and delta functions distributions. See Table 1, below. The 
delta function and Poisson networks have disordered dynamics at p=0.5 and 0.6. The power 
law networks have much shorter average periods in the periodic regime. 



[0043] Table 1 : Average Period for K=4 



Bias p 


0.5 


0.6 


0.7 


0.8 


0.9 


Delta function 






388 


53.2 


3.54 


Poisson 






308 


54.0 


3.65 


Power law 


268 


185 


133 


16.3 


3.52 
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• Discussion 

[0044] This study was done to investigate the relationship between topology and 
dynamics in biochemical networks. We have cited three pieces of recent experimental 
evidence that suggest that biochemical networks have broad distributions in the number of 
inputs and outputs. The possibility that these networks may have broad distributions has 
been suggested previously. For example, Somogyi and others 20 have proposed that 
multigenic (elements with many inputs and few outputs) and pleiotropic (elements with few 
inputs and many outputs) elements maybe common and important organizational themes in 
real cellular networks. Figure 6 schematically illustrates these two types of organizational 
themes, as well as two other types: "simple node" elements (few inputs and few outputs) and 
"super node" elements (many inputs and many outputs). The mammalian cell cycle provides 
several examples of these strategies. 11 RPasell (8 inputs, 2 outputs) is a multigenic element; 
ATM (2 inputs, 5 outputs), is a pleiotropic element; Max (one input, one output) is a simple 
node, while p53 (26 inputs 14 outputs) is a super node. Similar examples can be found in 
gene regulation networks. For example, some transcription factors such as the zinc-finger 
protein Spl in mammals control the expression of more than 300 genes. 24 Others, such as 
the lac repressor in E. coli bacteria, control only a single gene. 8 This variety of 
organizational strategies within a network is only possible if there is a broad distribution of 
connectivity. 

[0045] Motivated by evidence for broad distributions in real biochemical 
networks, we studied Boolean networks with delta function, Poisson, and power law 
distributions in number of inputs to see how these topological modifications affect dynamics 
of the network. We first analytically showed that in the thermodynamic limit, the critical 
point does not change with the addition of the distribution in K. This calculation was done 
by extending the method of Flyvbjerg. 19 

[0046] We next studied finite delta function, Poisson, and power law networks 
numerically. We characterized these three types of networks using three different measures: 
type of attractors, fraction of active elements, and length of period. We measured these 
three quantities as a function of the interaction bias p and the average connectivity K. We 
found that for all three measures, the power law nets show considerably more order than the 
delta function networks that had been studied previously. 
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[0047] One plausible mechanism that may contribute to this ordered behavior is 
the following. The power law distribution not only is characterized by a heavy tail; it also 
produces values of K near 1 with high probability, even if the mean value of K is large. 
These elements with few inputs are much more likely to be frozen, and these frozen 
elements reduce the size of the network that is still active by a significant fraction. These 
elements effectively reduce the mean value of K for the network; even if a particular element 
has a large number of inputs, a significant fraction of those inputs will be frozen. For 
example, for K=4 and p=0.7, we measured the effective mean K (the average number of 
active inputs to active elements) for all three distributions. We found that the delta function, 
Poisson, and power law distributions had effective mean values of K of 3.0, 2.7, and 2.1 . 
Thus, the order that is introduced by a large number of small K elements may outweigh the 
disorder produced by a few elements with very large K. 

[0048] Our numerical studies show that finite networks with broad, scale-free 
distributions in connectivity can show more order than networks with sharply peaked 
distributions. For a given number of elements N and a given mean connectivity Kmean, a 
network randomly selected using a scale-free distribution of K is more likely to be ordered 
than one selected using a tight distribution. Perhaps this fact is one reason why real 
biological networks exhibit broad distributions in connectivity. 

• Derivation of Critical Point 

[0049] For a distribution of inputs P(K), the "zeroth" way for an element to 

OO 

become frozen is if all K inputs are frozen. This probability is given by £ s k P(K) . The 

next way for an element to become frozen is if all but one of the inputs are frozen and if the 
state of this element is independent of the remaining active element. The probability of this 

CO 

occulting is given by £ K * / _1 (1 - s)p x P(K), where pt is the probability that an element 

with one input is independent of that input. In general, p k is defined as the probability that 
an element with k inputs is independent of all k inputs. This probability will depend on the 
bias of the network. 
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[0050] We can continue to write down these terms using similar reasoning. Thus 
the kth term in the sum will be given by £ — ■ — * /"*(1 - ^'ftW, where p 0 is 
defined to be 1. 

[0051] Summing all K+l terms gives us: 

ft 



+ = IE 



*s K -\l- S )" Pk P(K) (1) 



This is the expression of the return map. Now we let u=l-s, where u is the fraction of 
elements that are unfrozen. Then we have: 

(t^t#4^) *a-")^^^) (2) 

K „ xk ^ \k\(K-k)V 

[0052] Clearly u=u*=0 is a fixed point. Now we expand around this fixed point to 
study its stability. To find the critical point, we look at when this fixed point will go 
unstable. 

[0053] Let u=u*+5 with 8 a small number. Then we can rewrite equation (2), 
keeping only the zeroth and first order terms. The k=0 term in the sum provides one zeroth 
order term and one first order term. The k=l term in the sum provides one first order term. 
Adding these we have: 

<?(f + l) = l-{l+£-£*^^^ (3) 

[0054] Now, we know p 0 =l, so we must determine pi . Recall that pi is the 
probability that an element is independent of its only active input. If all but one input to an 
element are frozen, then the effective rule table for that element has only two entries, one for 
each state of the input element. For the state of the element to be independent of the input, 
we need both of these entries in its rule table to have the same value. This occurs with 
probability p 2 +(l-p) 2 , where p is the bias of the network. 
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[0055] We can now write: 



CO 



or 



(4) 



[0056] The fixed point goes unstable when the coefficient of the linear term has 
absolute value larger than 1. This occurs at: 



Additional Caption Information for Figures 1-6 

[0057] Figure 1 A: This figure shows the histogram for the mammalian cell cycle 
obtained from the Kohn Map} 2 Inputs to an element were defined as other elements that 
modified the behavior of the first element. Outputs were elements whose behavior was 
modified by the first element. We counted a total of 100 elements with at least one input in 
the Kohn Map. 

[0058] Figure IB: The dots are the data of Figure 1 A plotted in log-log format. 
The line is the fitted power law distribution for the network. The exponent is 1.12. 

[0059] Figure 2: This figure shows the theoretically obtained critical value of the 
bias p as a function of the mean number of inputs K mea n- In the N -> oo, networks with 
values of p above the critical value would have only frozen elements. 

[0060] Figure 3: This figure shows the fraction of disordered (period > 1500) nets 
as a function of p for K=4 (Figure 3A) and 6 (Figure 3B) and N=100. For K=2, nearly all 
nets are ordered for any p. Note that for K=4, far fewer power law nets are disordered. 

[0061] Figure 4: This figure shows the fraction of active, or unfrozen, elements in 
a network as a function of bias p for K=2, 4, and 6 and N=100, in Figures 4A, 4B, and 4C, 
respectively. Note the significant fraction of frozen elements in the power law nets for p= 
0.5 andK=4andK=6. 

[0062] Figure 5 : This figure shows the lower bound of the fraction of frozen 
elements in power law nets as a function of the exponent beta in the power law with a bias 




(5) 
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p=0.5. This lower bound is found by considering how many elements will be independent 
of all K inputs. For comparison, we place a dot at the values of beta that correspond to the 
three values of Kmean that we use in our simulations. For Kmean-2, the frozen component is 
significantly larger than the lower bound, but as Kmean increases (P decreases), the frozen 
component remains closer to the lower bound. 

[0063] Figure 6: This is a schematic of the four types of organizations: 

A. "Simple node" -A node with few inputs and few outputs. Max is an 
example from the Kohn Map. 

B. "Pleiotropic node" - A node with few inputs and many outputs. ATM 
is an example from the Kohn Map. 

C. "Multigenic node" - A node with many inputs and few outputs. 
RPasell is an example from the Kohn Map. 

D. "Super node" -A node with many inputs and many outputs. p53isan 
example from the Kohn Map. 
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Generalized Network Inference Methods 

[0065] Also described herein is a system for inferring one or a population of 
biochemical interaction networks, including topology and chemical reaction rates and 
parameters, from dynamical or static experimental data, with or without spatial localization 
information, and a database of possible interactions. Accordingly, the invention, as 
described herein, may provide systems and methods that can infer the biochemical 
interaction networks that exist in a cell. To this end, the systems and methods described 
herein generate a plurality of possible candidate networks and then apply to these networks a 
forward simulation process to infer a network. Inferred networks may be analyzed via data 
fitting and other fitting criteria, to determine the likelihood that the network is correct. In 
this way, new and more complete models of cellular dynamics may be created. 

[0066] Figure 8 depicts a model generator 12 that creates new model networks, 
drawing from a combination of sources including a population of existing networks 14 and a 
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probable links database 16. Once generated, a parameter-fitting module 18 evaluates the 
model network, determining parameter values for the model network based on experimental 
data 20. A simulation process 26 may aid the optimization of the parameters in the 
parameter-fitting module 18. An experimental noise module 22 may also be used in 
conjunction the parameter-fitting module 18 to evaluate the model's sensitivity to 
fluctuations in the experimental data 20. Finally, a cost evaluation module 24 may test the 
reliability of the model and parameters by examining global and local fitness criteria. 

[0067] A population of existing networks 14 stores previously inferred network 
models in a computer database and may provide network models to a model generator 12 for 
the generation of new network models. Completed network models are added to the 
population of existing models 14 for storage, transferred from a cost-evaluation module 24. 

[0068] A probable links database 16 stores data representative of biochemical 
interactions obtained from bioinformatics predictions, and may also include hypothetical 
interactions for which there is some support in the published literature. The probable links 
database 16 couples with the model generator 12 to provide links for the formation of new 
network models where necessary. 

[0069] The model generator 12 uses any of a number of model-fitting techniques 
that are known to those of skill in the art to generate new biochemical network models. In 
one embodiment, the model generator 12 employs genetic algorithms to generate new 
networks, using two networks present in the population. Such genetic algorithms may use 
other information to guide the recombination of networks used in constructing new 
networks, such as sensitivity analysis of the parameters of one or both of the parent 
networks. They may also use the results of clustering analyses to group together networks in 
the population that behave in similar ways dynamically, and selectively recombine networks 
belonging to the same dynamical cluster or, for heterotic vigor, recombine networks 
belonging to different dynamical clusters but which fit the data approximately equally well. 
In creating the new network model, the model generator 12 may draw one or more networks 
from the population of existing networks 14 and incorporate any number of possible 
interactions from the probable links database 16. Alternatively, the model generator 12 may 
rely solely on the probable links database 16, generating a new network model without 
relying on the population of existing networks 14. 
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[0070] In one practice, the model generator 12 uses multiple evaluation criteria, 
e.g. finite state machines, to test generated networks for compatibility with experimental 
data, as in Conradi et al. (C. Conradi, J. Stelling, J. Raisch, "Structure discrimination of 
continuous models for (bio)chemical reaction networks via finite state machines," IEEE 
International Symposium on Intelligent Control (2001), p. 138). The model generator may 
also use Markov Chain Monte Carlo methods (W. Gilks, S. Richardson and D. 
Spiegelhalter, Markov Chain Monte Carlo in Practice, Chapman and Hall, 1996), or 
variational methods (such as those described in M. Jordan, Z. Ghahramani, T. Jaakkola, L. 
Saul, "An introduction to variational methods for graphical models," in Learning in 
Graphical Models (M. Jordan, ed.), MIT Press, 1998), or loopy belief propagation (J. Pearl, 
Causality: Models. Reasoning and Inference, Cambridge Univ. Press, 2000), for inferring 
the likelihood of a given network topology, given the experimental data. Network 
topologies that are unlikely, given the experimental data, would be accepted at a lower rate 
than those that are likely, as in the Metropolis algorithm for Monte Carlo simulations. The 
model generator may also use the results of clustering large-scale or high-throughput 
experimental measurements, such as mRNA expression level measurements, perhaps 
combined with bioinformatics predictions such as for genes with common binding sites for 
transcription factors, or secondary structure predictions for proteins that may be possible 
transcription factors, to generate models consistent with these clustering and bioinformatics 
results, in combination or singly. The model generator may also include reactions suggested 
by a control theory based module, which can evaluate portions of a given network in the 
population and modify them according to calculations based on robust control theory (such 
as that suggested by F.L. Lewis in A pplied Optimal Control and Estimation, Prentice-Hall, 
1992). 

[0071] As will be understood by one of ordinary skill in the art, the systems and 
methods described herein allow for generating a population of networks and evaluating 
predictions from this population in a manner that is similar or equivalent to a Monte Carlo 
evaluation of the likelihood that the model is correct, in the Bayesian sense over the 
ensemble of all networks, weighted by the a priori measure of the space of networks. With 
model generation complete, the newly generated network model passes from the model 
generator 12 to a parameter fitting module 1 8 for optimization of the network parameters. 

[0072] A parameter fitting module 1 8 optimizes the model parameters received 
from the model generator 12 using experimental data 20 as a calibration point, either in a 
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single step or by coupling with a simulation module 26 for iterative parameter fitting. 
Optimization methods may be according to any global or local routine or combination of 
routines known to one of skill in the art. Examples include, but are not limited to local 
optimization routines such as Levenberg-Marquardt, modified Levenberg-Marquardt, 
BFGS-updated secant methods, sequential quadratic programming, and the Nelder-Mead 
method, or global optimization routines such as simulated annealing or adaptive simulated 
annealing, basic Metropolis, genetic algorithms, and direct fitting. Following parameter 
optimization, the parameter fitting module 18 passes the network model to a cost evaluation 
module 24. 

[0073] The experimental data 20 consists of qualitative or quantitative 
experimental data, such as mRNA or protein levels, stored in a computer database. The 
experimental data 20 may be obtained through any of a variety of high-throughput data 
collection techniques known to one of skill in the art, including but not limited to 
immunoprecipitation assays, Western blots, or other assays known to those of skill in the art, 
and gene expression from RT-PCR or oligonucleotide and cDNA microarrays. The 
experimental data 20 couples directly with the parameter fitting module 18 for parameter 
optimization, and may also couple with an experimental noise module 22. In other 
practices, the systems and methods described herein employ other types of data, including, 
for example, spatial localization data. Preferably, the model has (x,y,z,t) spatial and 
temporal coordinates for components as well. Confocal microscopy is one of the 
technologies for getting both dynamical and spatial localization. One example of why this is 
important is that the total levels of protein A may not change at all as a result of the 
perturbation. But its levels in the cytosol versus nucleus may be changing as a result of the 
perturbation whereby A is getting translocated from cytosol to nucleus to participate in other 
processes. Our inference may use both dynamical and static data, as well as information on 
spatial localization. 

[0074] An experimental noise module 22 may be used to provide an indication of 
the model's sensitivity to small variations in experimental measurements. The noise module 
22 acts as an interim step between the experimental data 20 and the parameter fitting module 
18, introducing variations into the experimental data 20 for evaluation following parameter 
optimization in a cost-evaluation module 24. The noise generation could be implemented by 
modeling the uncertainty in any given experimental observation by an appropriate 
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distribution (e.g. log-normal for expression data) and picking noise values as dictated by the 
distribution for that experimental observation. 

[0075] With a completed biochemical network model, an optional cost evaluation 
module 24 may evaluate the network model received from the parameter fitting module 18 
according to cost or fitness criteria The cost evaluation module 24 ranks a model's 
reliability according to the chosen fitness or cost criteria. The criteria employed by the cost 
evaluation module 24 may include, but are not limited to: (1) insensitivity of the model to 
changes in the initial conditions or chemical reaction parameters, (2) robustness of the 
model to the random removal or addition of biochemical interactions in the network, (3) 
insensitivity to variations in the experimental data (with variations introduced into the 
experimental data in the experimental noise data 22), and (4) overall bioinfonnatics costs 
associated with the model. Examples of bioinfonnatics costs are the number of gene 
prediction algorithms that simultaneously agree on a particular gene, the number of 
secondary structure prediction algorithms that agree on the structure of a protein, and so on. 
Coupled to this, some bioinfonnatics algorithms allow comparison to synthetically 
generated sequence (or other) data, thereby allowing the calculation of likelihoods or 
confidence measures in the validity of a given prediction. The cost evaluation module 24 
then adds the new network model and the results of its cost criteria to the population of 
existing networks 14. 

[0076] Models in the population of existing networks continue to be evaluated and 
tested by adding and removing links in iterative operations of the system herein described. 
There is no specific starting point in the system. Users of the system may generate networks 
entirely from the probable links database 16, or from a combination of the probable links 
database 16 with the population of existing networks 14. Iterative refinement may continue 
until a single network attains a goodness of fit to experimental data, perhaps combined with 
low costs for dynamical robustness or other criteria, below a user defined threshold, or a 
stable dynamically similar cluster of networks emerges from the population of networks. 
This stable cluster may then be used to compute robust predictions by averaging over the 
predictions of elements of the cluster of networks, in a cost-weighted average, where the 
costs include, but are not limited to, goodness of fit to the experimental data, dynamical 
robustness, probabilistic or exact evaluation of insensitivity to experimental noise and/or 
parameter values. Thus networks with lower costs contribute more to predictions than 
networks with higher costs. The refinement of the pool of networks may be continued until 
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the (average or best) goodness of fit of the networks in the stable cluster is below some user 
defined threshold, or until the number of networks in the cluster is above some user defined 
threshold. In the case of the single network that may be the result of the inference process, 
the single network may be solely used for generating predictions. 

[0077] The depicted process shown in Figure 8 can be executed on a conventional 
data processing platform such as an IBM PC-compatible computer running the Windows 
operating systems, or a Sun workstation running a UNIX operating system. Alternatively, 
the data processing system can comprise a dedicated processing system that includes an 
embedded programmable data processing system. For example, the data processing system 
can comprise a single board computer system that has been integrated into a system for 
performing microarray analysis. The process depicted in Figure 8 can be realized as a 
software component operating on a conventional data processing system such as a UNIX 
workstation. In that embodiment, the process can be implemented as a C language computer 
program, or a computer program written in any high level language including C++, 
FORTRAN, Java, or Basic. The process may also be executed on commonly available 
clusters of processors, such as Western Scientific Linux clusters, which are able to allow 
parallel execution of all or some of the steps in the depicted process. 

[0078] Accordingly, the systems and methods described herein include systems 
that create a pool of candidate or possible networks that have been generated to match data, 
including data that is biologically realistic as it arises from relevant literature or experiments. 
The systems described herein may, in certain embodiments, apply a discriminator process to 
the generated pool of possible networks. In an iterative process, the system may employ 
pools identified by the discriminator process as data that may be applied to a network 
generation module. The network generation module can process these possible networks 
with data from the probable links database to generate output data that can be processed by 
the fitting module as described above. In this way the systems and methods described herein 
may derive predictions from a pool of networks, instead of processing biological data to 
generate a single unique network. 

Alternate Embodiments 

[0079] Those skilled in the art will know or be able to ascertain using no more 
than routine experimentation, many equivalents to the embodiments and practices described 
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herein. Accordingly, it will be understood that the invention is not to be limited to the 
embodiments disclosed herein, but is to be interpreted as broadly as allowed under the law. 

[0080] The order in which the steps of the present method are performed is purely 
illustrative in nature. In fact, the steps can be performed in any order or in parallel, unless 
otherwise indicated by the jpresent disclosure. 

[0081] The method of the present invention may be performed in either hardware, 
software, or any combination thereof, as those terms are currently known in the art. hi 
particular, the present method may be carried out by software, firmware, or microcode 
operating on a computer or computers of any type. Additionally, software embodying the 
present invention may comprise computer instructions in any form (e.g., source code, object 
code, interpreted code, etc.) stored in any computer-readable medium (e.g., ROM, RAM, 
magnetic media, punched tape or card, compact disc (CD) in any form, DVD, etc.). 
Furthermore, such software may also be in the form of a computer data signal embodied in a 
carrier wave, such as that found within the well-known Web pages transferred among 
devices connected to the Internet. Accordingly, the present invention is not limited to any 
particular platform, unless specifically stated otherwise in the present disclosure. 

[0082] While particular embodiments of the present invention have been shown 
and described, it will be apparent to those skilled in the art that changes and modifications 
may be made without departing from this invention in its broader aspect and, therefore, the 
appended claims are to encompass within their scope all such changes and modifications as 
fall within the true spirit of this invention. 
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1 CLAIMS 

2 We claim: 



3 LA method of inferring a network model of a process, comprising: 

4 generating a search space of candidate networks; 

5 reducing said search space by eliminating one or more non-fitting candidate 

6 networks to form a reduced search space; 

7 testing said candidate networks in said reduced search space against one or more 

8 criteria to identify an ensemble of networks; and 

9 modeling said process using said ensemble of networks. 

10 2. The method of Claim 1 , wherein said reducing further comprises: 

1 1 identifying one or more scale-free candidate networks in said search space; and 

12 classifying all non-scale-free candidate networks as non-fitting candidate networks 

1 3 based on said identifying. 

14 3. The method of Claim 1, wherein said process is a biologic process. 

15 4. The method of Claim 1, wherein said ensemble of networks is a Bayesian 

16 ensemble. 
17 

18 

19 5. An apparatus for inferring a network model of a process, comprising: 

20 means for generating a search space of candidate networks; 

21 means for reducing said search space by eliminating one or more non-fitting 

22 candidate networks to form a reduced search space; 

23 computer means for testing said candidate networks in said reduced search space 

24 against one or more criteria to identify an ensemble of networks; and 

25 computer means for modeling said process using said ensemble of networks. 

26 6. The apparatus of Claim 5, wherein said reducing means further comprises: 

27 means for identifying one or more scale-free candidate networks in said search 

28 space; and 
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1 means for classifying all non-scale-free candidate networks as non-fitting candidate 

2 networks based on said identifying. 

3 7. The apparatus of Claim 5, wherein said process is a biologic process. 

4 8. The apparatus of Claim 5, wherein said ensemble of networks is a Bayesian 

5 ensemble. 
6 

7 

8 9. A computer system for use in inferring a network model of a process, 

9 comprising computer instructions for: 

1 0 generating a search space of candidate networks; 

1 1 reducing said search space by eliminating one or more non-fitting candidate 

12 networks to form a reduced search space; 

13 testing said candidate networks in said reduced search space against one or more 

14 criteria to identify an ensemble of networks; and 

1 5 modeling said process using said ensemble of networks. 

16 10. The computer system of Claim 9, wherein said computer instructions for 

17 reducing further comprise computer instructions for: 

18 identifying one or more scale-free candidate networks in said search space; and 

1 9 classifying all non-scale-free candidate networks as non-fitting candidate networks 

20 based on said identifying. 

21 11. The computer system of Claim 9, wherein said process is a biologic process. 

22 12. The computer system of Claim 9, wherein said ensemble of networks is a 

23 Bayesian ensemble. 
24 

25 

26 13. A computer-readable medium storing a computer program executable by a 

27 plurality of server computers, the computer program comprising computer instructions for: 

28 generating a search space of candidate networks; 
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1 reducing said search space by eliminating one or more non-fitting candidate 

2 networks to form a reduced search space; 

3 testing said candidate networks in said reduced search space against one or more 

4 criteria to identify an ensemble of networks; and 

5 modeling said process using said ensemble of networks. 

6 14. The computer-readable medium of Claim 13, wherein said computer 

7 instructions for reducing further comprise computer instructions for: 

8 identifying one or more scale-free candidate networks in said search space; and 

9 classifying all non-scale-free candidate networks as non-fitting candidate networks 

1 0 based on said identifying. 

11 15. The computer-readable medium of Claim 13, wherein said process is a 

12 biologic process. 

13 16. The computer-readable medium of Claim 13, wherein said ensemble of 

14 networks is a Bayesian ensemble. 
15 

16 

17 1 7. A computer data signal embodied in a carrier wave, comprising computer 

18 instructions for: 

1 9 generating a search space of candidate networks; 

20 reducing said search space by eliminating one or more non-fitting candidate 

2 1 networks to form a reduced search space; 

22 testing said candidate networks in said reduced search space against one or more 

23 criteria to identify an ensemble of networks; and 

24 modeling said process using said ensemble of networks. 

25 18. The computer data signal of Claim 17, wherein said computer instructions for 

26 reducing further comprise computer instructions for: 

27 identifying one or more scale-free candidate networks in said search space; and 

28 classifying all non-scale-free candidate networks as non-fitting candidate networks 

29 based on said identifying. 
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1 19. The computer data signal of Claim 17, wherein said process is a biologic 

2 process. 

3 20. The computer data signal of Claim 1 7, wherein said ensemble of networks is 

4 a Bayesian ensemble. 
5 

6 
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